LSR1 analysis: Pro-dopaminergic pharmacological interventions for anhedonia in depression
Francesca Tinsdeall, Fiona Ramage, Virginia Chiocchia and Malcolm Macleod
12 February 2024
- 1. Flow of study selection and descriptives
- 2 Effects of model induction
- 3 Dopaminergic agent v Control
- 4. Observed relationships between different outcomes measures in the same cohorts of animals
- 5. Attrition bias and adverse effects of treatment
- 6. Summary of the evidence
- 7. Software used
1. Flow of study selection and descriptives
The flow of study selection is shown in Figure 1. Studies included were published between 1991 and 2023. Overall, this analysis includes 29 studies containing 272 comparisons.
Figure 1
Table 1 below gives a summary of the included studies for the effect of model induction. N represents an aggregate of animals contributing to outcomes reported from control and treatment groups, and if the same control group has contributed to more than one experiment, those animals will be counted more than once.
| Study | Model | Strain | Outcome | N |
|---|---|---|---|---|
| AMIRI, 2016 | maternal separation | NMRI | Sucrose preference test | 24 |
| BORGES, 2013 | iuGC | Wistar (rat) | DOPAC concentration | 20 |
| ~ | ~ | ~ | Dopamine concentration | 20 |
| ~ | ~ | ~ | Sucrose preference test | 14 |
| BROCCO, 2006 | CMS | Wistar (rat) | Sucrose preference test | 288 |
| CARRATAL, 2023 | Tetrabenzine | CD-1 (mouse) | Sucrose preference test | 132 |
| EREN, 2007 | CMS | Wistar (rat) | Sucrose preference test | 80 |
| EREN, 2014 | CUMS | Wistar (rat) | Sucrose preference test | 64 |
| FATIMA, 2020 | PNS | Wistar (rat) | Dopamine receptor biology | 24 |
| ~ | ~ | ~ | Sucrose preference test | 12 |
| JIANG, 2014 | Defeat | C57BL/6J (mouse) | Sucrose preference test | 100 |
| KOO, 2018 | MCAO | C57BL/6 (mouse) | Sucrose preference test | 36 |
| KRUPINA, 1995 | MPTP | Wistar (rat) | Sucrose preference test | 480 |
| MUSCAT, 1992 | CMS | Lister hooded (rat) | Sucrose preference test | 40 |
| OSACKA, 2022 | CMS | Sprague-dawley (rat) | Sucrose preference test | 21 |
| PAPP, 1993 | CUMS | Lister hooded (rat) | Sucrose preference test | 128 |
| QIAO, 2020 | CUS | Sprague-dawley (rat) | Dopamine concentration | 24 |
| ~ | ~ | ~ | Dopamine receptor biology | 24 |
| ~ | ~ | ~ | Sucrose preference test | 24 |
| RANA, 2014 | CMS | Swiss albino | Sucrose preference test | 60 |
| TAN, 2015 | TBI | Sprague-dawley (rat) | DOPAC concentration | 120 |
| ~ | ~ | ~ | Dopamine concentration | 120 |
| ~ | ~ | ~ | Sucrose preference test | 60 |
| TOMAZ, 2020 | LPS | Wistar (rat) | Sucrose preference test | 16 |
| WANG, 2021 | CUS | C57BL/6 (mouse) | Sucrose preference test | 16 |
| WEI, 2021 | CMS | C57BL/6J (mouse) | Sucrose preference test | 12 |
| WILLNER, 1994 | CUMS | PVG Hooded | Sucrose preference test | 44 |
| WU, 2014 | CUMS | Sprague-dawley (rat) | Sucrose preference test | 12 |
| YAN, 2022 | CUMS | Sprague-dawley (rat) | DA/DOPC ratio | 60 |
| ~ | ~ | ~ | Dopamine concentration | 60 |
| ~ | ~ | ~ | Sucrose preference test | 20 |
| YU, 2016 | CUS | Wistar (rat) | Sucrose preference test | 48 |
| YUAN, 2011 | CUMS | Sprague-dawley (rat) | Sucrose preference test | 17 |
| ZHAO, 2018 | CMS | Sprague-dawley (rat) | Sucrose preference test | 60 |
Glossary
iuGC - intra-uterine glucocorticoid: CMS - chronic mild stress: CUMS - chronic unpredictable mild stress: CUS - chronic unpredicatble stress: PNS - prenatal stress: Defeat - social defeat stress: TBI - traumatic brain injury: LPS - intraperitoneal lipopolysaccharide: MCAO - middle cerebral artery occlusion: WAG/Rij = genetic model of absence epilepsy with co-morbid depression
Table 2 below gives a summary of the included studies for the effect of doapminergic interventions. N represents an aggregate of animals contributing to outcomes reported from control and treatment groups, and if the same control group has contributed to more than one experiment, it will be counted twice.While some authors considered imipramine to have dopaminergic effects, we considered, given that this was a minor contribution to its pharmacological repertoire, that these studies should not be included in this iteration of the review.
| Study | Model | Strain | Comparison | Outcome | N |
|---|---|---|---|---|---|
| AMIRI, 2016 | maternal separation | NMRI | selegiline, 1 mg/kg | Sucrose preference test | 12 |
| ~ | ~ | ~ | selegiline, 3 mg/kg | ~ | 24 |
| ~ | ~ | ~ | selegiline, 5 mg/kg | ~ | 12 |
| BORGES, 2013 | iuGR | Wistar (rat) | L-DOPA, 24 mg/kg | DOPAC concentration | 20 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 20 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 14 |
| BROCCO, 2006 | CMS | Wistar (rat) | piribedil, 10 mg/kg | Sucrose preference test | 96 |
| ~ | ~ | ~ | piribedil, 2.5 mg/kg | ~ | 96 |
| ~ | ~ | ~ | piribedil, 40 mg/kg | ~ | 96 |
| CARRATAL, 2023 | Tetrabenzine | CD-1 (mouse) | buproprion, 10 mg/kg | Sucrose preference test | 132 |
| EREN, 2007 | CMS | Wistar (rat) | aripiprazole, 2.5 mg/kg | Sucrose preference test | 80 |
| EREN, 2014 | CUMS | Wistar (rat) | aripiprazole, 2.5 mg/kg | Sucrose preference test | 64 |
| FATIMA, 2020 | PNS | Wistar (rat) | ropinirole, 10 mg/kg | Dopamine receptor biology | 24 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 12 |
| JIANG, 2014 | Defeat | C57BL/6J (mouse) | SKF83959, 0.5 mg/kg | Sucrose preference test | 20 |
| ~ | ~ | ~ | SKF83959, 1 mg/kg | ~ | 100 |
| KOO, 2018 | MCAO | C57BL/6 (mouse) | aripiprazole, 1 mg/kg | Sucrose preference test | 36 |
| MUSCAT, 1992 | CMS | Lister hooded (rat) | quinpirole, 200 ug/kg | Sucrose preference test | 40 |
| OSACKA, 2022 | CMS | Sprague-dawley (rat) | aripiprazole, 10 mg/kg | Sucrose preference test | 22 |
| PAPP, 1993 | CUMS | Lister hooded (rat) | quinpirole, 100 ug/kg | Sucrose preference test | 96 |
| ~ | ~ | ~ | quinpirole, 200 ug/kg | ~ | 96 |
| ~ | ~ | ~ | quinpirole, 400 ug/kg | ~ | 96 |
| QIAO, 2020 | CUS | Sprague-dawley (rat) | dopamine, 3.83 ug | Sucrose preference test | 24 |
| ~ | ~ | ~ | quinpirole, 0.877 ug | ~ | 24 |
| RANA, 2014 | CMS | Swiss albino | L-DOPA, 200 mg/kg & simvastatin, 10 mg/kg | Sucrose preference test | 60 |
| ~ | ~ | ~ | bromocriptine, 2 mg/kg & simvastatin, 10 mg/kg | ~ | 60 |
| ~ | ~ | ~ | simvastatin, 10 mg/kg | ~ | 60 |
| RUSSO, 2013 | WAG/Rij rat | WAG/Rij | aripiprazole, 0.3 mg/kg | Sucrose preference test | 20 |
| ~ | ~ | ~ | aripiprazole, 1 mg/kg | ~ | 20 |
| ~ | ~ | ~ | aripiprazole, 3 mg/kg | ~ | 20 |
| TAN, 2015 | TBI | Sprague-dawley (rat) | amantadine, 45 mg/kg | DOPAC concentration | 112 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 112 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 56 |
| ~ | ~ | ~ | amantadine, 135 mg/kg | DOPAC concentration | 112 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 112 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 56 |
| TOMAZ, 2020 | LPS | Wistar (rat) | tranylcypromine, 10 mg/kg | Sucrose preference test | 16 |
| WANG, 2021 | CUS | C57BL/6 (mouse) | cryptotanshinone, 20 mg/kg | Sucrose preference test | 16 |
| WEI, 2021 | CMS | C57BL/6J (mouse) | pramipexole, 1 mg/kg | Sucrose preference test | 12 |
| WILLNER, 1994 | CUMS | PVG Hooded | pramipexole, 1 mg/kg | Sucrose preference test | 88 |
| ~ | ~ | ~ | pramipexole, 2 mg/kg | ~ | 88 |
| WU, 2014 | CUMS | Sprague-dawley (rat) | SKF38393, 1.12 ug | Sucrose preference test | 12 |
| YAN, 2022 | CUMS | Sprague-dawley (rat) | P. orientalis seed, 10 mg/kg | DA/DOPC ratio | 60 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 60 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 20 |
| ~ | ~ | ~ | P. orientalis seed, 33 mg/kg | DA/DOPC ratio | 60 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 60 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 20 |
| ~ | ~ | ~ | P. orientalis seed, 100 mg/kg | DA/DOPC ratio | 60 |
| ~ | ~ | ~ | ~ | Dopamine concentration | 60 |
| ~ | ~ | ~ | ~ | Sucrose preference test | 20 |
| YU, 2016 | CUS | Wistar (rat) | amantadine, 25 mg/kg | Sucrose preference test | 48 |
| YUAN, 2011 | CUMS | Sprague-dawley (rat) | SKF38393, 1.12 ug/kg | Sucrose preference test | 16 |
| ZHAO, 2018 | CMS | Sprague-dawley (rat) | 2_HBC, 10 mg/kg | Sucrose preference test | 60 |
| ~ | ~ | ~ | 2_HBC, 2.5 mg/kg | ~ | 60 |
| ~ | ~ | ~ | buproprion, 2.5 mg/kg | ~ | 60 |
References of included studies are located in the appendix. Included studies used 30 unique disease model induction procedures.
1.1 Description of experiment types and methodological approach
Within the literature we identified distinct categories of experiments and the data presented would allow several meta-analytical contrasts to be drawn:
Effects of disease modelling. These are experiments investigating the effect of models of depression, reported in 139 experiments from 28 publications.
In these studies the:
Control group is a group of animals that is (1) not subjected to a depression model induction paradigm and (2) is administered a control treatment (vehicle) or no treatment.
Intervention group is a group of animals that is (1) subjected to a depression model induction paradigm and (2) is administered a control treatment (vehicle) or no treatment.
Treatment vs control. These were experiments investigating the effect of administering a dopaminergic agent, reported in 133 experiments from 26 publications.
In these studies the:
Control group is a group of animals that is (1) subjected to a depression model induction paradigm and (2) administered a control treatment (vehicle) or no treatment.
Intervention group is a group of animals that is (1) subjected to a depression model induction paradigm and (2) administered a TAAR1 agonist treatment.
Sham group is a group of animals that is (1) not subjected to a depression model induction paradigm and (2) administered a control treatment (vehicle) or no treatment. These data are required to allow a ‘normalised mean difference’ effect size to be calculated, given by
\[ \frac{{\bar{\mu}_C - \bar{\mu}_T}}{{\bar{\mu}_C - \bar{\mu}_S}} \times 100 \]
where \(\bar{\mu}_C\), \(\bar{\mu}_T\), \(\bar{\mu}_S\) are the mean reported scores in the control, treatment, and sham groups respectively.
Outcomes with ≥2 independent effect sizes were considered for meta-analysis. In this iteration of the review, this includes sucrose preference test, dopamine concentration, dopamine receptor biology and dopac concentration.
All analyses were conducted allowing for the following hierarchical levels in a random effects model, which accounts for features common to experimental contrasts such as a shared control group:
Level 1: Rodent strain - effect sizes measured across experiments using the same rodent strain.
Level 2: Study - effect sizes measured from different experiments presented in the same publication.
Level 3: Experiment - effect sizes measured in the same experiment within a study, where often a control group contributes to several effect sizes.
Each level for the heirarchy was only included in the model if more than 4 categories were present for at least one of these levels. Where more than 4 categories are not present for all levels, the variance attributable to that level is reported as zero.
The hierarchical grouping may therefore be considered thus: Strains of laboratory animals are included in several Studies, each of which can report one or more Experiments, and each Experiment is comprised of at least two Cohorts which are considered identical except for differing in the experimental manipulation (the Intervention) or not being exposed to the disease modelling procedures (a Sham cohort, these only being used to provide a baseline for outcome measures to allow Normalised Mean Difference meta-analysis). An Experiment can include several experimental contrasts, for instance where different doses of drugs are compared to the same control group.
We constructed multilevel models without Knapp-Hartung adjustments as
these are not available for rma.mv class objects in the metafor package.
Instead, the model is set to test = "t" to use t- and
F-distributions for making inferences, and dfs="contain" to
improve the method of approximating degrees of freedom of these
distributions.
The scales and units used to measure outcomes in preclinical studies often differ between studies although they may measure the same underlying biological construct. The primary effect size used for meta-analysis of preclinical studies is therefore the standardised mean difference (SMD, Hedge’s g). For experiments testing the effects of interventions we also present a sensitivity analysis using normalised mean difference (NMD), where there are sufficient data for sham procedures to allow this. This analysis is not possible for studies of the effect of modelling depression.
For some experimental contrasts, more than one outcome of the same category - for instance dopamine concentrations in different brain regions - was measured in the same cohort of animals. Sometimes, sucrose preference tests were performed in the same cohort at different times. Some publications used the same drug doses with the same outcome measures in independent experiments. For these reasons, some of the forest plots may appear to include ‘duplicate’ Study - Drug - Dose combinations with different outcomes. For the later, these are accounted for in the hierarchical analysis, but for the former there were insufficient levels of the different outcome category measured to allow for hierarchical analysis and so this was not performed.
2 Effects of model induction
28 studies (139 comparisons) investigated the effects of model induction. The number of studies and individual effect sizes for each outcome were:
Sucrose preference*: 28 studies and 109 comparisons in 9 strains
Dopamine concentration: 5 studies and 13 comparisons in 3 strains
DOPAC concentration: 2 studies and 3 comparisons in 2 strains
DA/DOPAC ratio: 1 studies and 3 comparisons in 1 strain
Dopamine receptor biology: 3 studies and 11 comparisons in 2 strains
* This outcome was identified in the study protocol as the primary outcome of interest.
2.1 Outcome 1: Sucrose preference
2.1.1 Risks of bias
Figure 2.1.1 shows the risk of bias summary for studies investigating the effect of modelling depression on sucrose preference in animals. The risk of bias assessment was performed using the SyRCLE RoB tool.
Figure 2.1.1
2.1.2 Reporting completeness
Figure 2.1.2 shows the reporting completeness summary for studies investigating the effect of modelling depression on sucrose preference in animals. The reporting completeness assessment was performed using the ARRIVE guidelines.
Figure 2.1.2
2.1.3 Meta-analysis
The effect of modelling depression on sucrose preference in animals using SMD as the effect size is shown in Figure 2.1.3. The pooled estimate for SMD across all individual comparisons is displayed as a diamond shape at the bottom of the plot. Dotted lines indicate the prediction interval of the pooled estimate.
Figure 2.1.3
Depression modelling had a pooled effect on sucrose preference of SMD = -1.77 , (95% CI: -2.541 to -1 with a prediction interval of -5.538 to 1.997.
109 experimental comparisons were reported in 37 experiments reported from 28 publications and involving 9 different animal strains.
The following table structure is used throughout this report and is used to show the different levels contributing to that analysis, the number of unique categories in those levels, and the variance contributed by that level of analysis. Because levels are only included in the analysis where there are five or more unique categories, for some analyses the number of categories is 0, and the variance attributed to those levels in not applicable. Because the model is hierarchical, where for instance there are Studies which include different Strains, the number of categories for Study x Strain will exceed the number of Studies (by which we mean unique publications) referred to in the text.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.041 |
| Study x Strain | 28 | 2.502 |
| Study x Strain x Experiment | 37 | 0.014 |
2.1.4 Subgroup analyses and meta-regressions
For each outcome, the covariates of interest for subgroup analyses and meta-regressions were:
Sex
Method of disease induction
We also conducted subgroup analyses using (1) SyRCLE Risk of Bias and (2) ARRIVE reporting completeness assessment scores as covariates to evaluate their influence on effect size estimates. These were not specified in the study protocol, but evaluation of risk of bias is required for the Summary of Evidence table, and no studies were considered entirely at low risk of bias or of high reporting completeness to allow such a sensitivity analysis
The significance (p value) reported is that for a test of whether the moderators are significantly different one from another, rather than whether the effect is significantly different from 0.
Sex
Figure 2.1.4.1 displays the estimates for the pooled SMD’s when comparisons are stratified by sex of the animal. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by sex, is displayed as a diamond shape at the bottom of the plot.
Figure 2.1.4.1
The p-value for the association between the sex of animal groups used and outcome reported was 0.033.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0 |
| Study x Strain | 28 | 1.745 |
| Study x Strain x Experiment | 37 | 0 |
Category of disease induction
Figure 2.1.4.2 displays the estimates for the pooled SMD’s when comparisons are stratified by the category of disease induction. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by category of disease induction, is displayed as a diamond shape at the bottom of the plot.
Figure 2.1.4.2
The p-value for the association between the depression model used and the outcome reported was 0.429.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.027 |
| Study x Strain | 28 | 2.927 |
| Study x Strain x Experiment | 37 | 0.011 |
SyRCLE RoB assessment considered as a categorical variable
Figure 2.1.4.3 displays the estimates for the pooled SMD’s when comparisons are stratified by how many of the SyRCLE risk of bias assessment criteria (of which there are 10) that the experiment met. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by SyRCLE Risk of Bias, is displayed as a diamond shape at the bottom of the plot.
Figure 2.1.4.3
The p-value for the association between SyRCLE Risks of Bias reporting and outcome reported was 0.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.249 |
| Study x Strain | 28 | 1.261 |
| Study x Strain x Experiment | 37 | 0.015 |
SyRCLE RoB assessment considering those studies where any item is at low risk of bias
Figure 2.1.4.4 displays the estimates for the pooled SMD’s when comparisons are stratified by whether of not any of the SyRCLE Risk of bias domains were rated as low risk of bias. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by SyRCLE Risk of Bias, is displayed as a diamond shape at the bottom of the plot.
Figure 2.1.4.4
The p-value for the association between low SyRCLE Risks of Bias reporting and outcome reported was 0.086.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.062 |
| Study x Strain | 28 | 2.534 |
| Study x Strain x Experiment | 37 | 0.013 |
ARRIVE reporting completeness guidelines
We provide a metaregression where the number of ARRIVE items met is considered as a continuous variable.
Figure 2.1.4.5
The p-value for the association between ARRIVE reporting completeness and outcome reported was 0.556).
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.121 |
| Study x Strain | 28 | 2.575 |
| Study x Strain x Experiment | 37 | 0.013 |
Heterogeneity explained by covariates (Effect of modelling on Sucrose preference)
The table below shows which of the covariates, if any, explain some of the heterogeneity observed in the effect sizes of the effect of TAAR1 agonists on Sucrose preference. We present marginal R2, which measures the proportion of variance explained by including moderators in the model (the % change in the between-studies variance when the covariate is included in the model, in other words the % of the heterogeneity explained by the variable). The co-efficients are derived form an RMA model fitted with an intercept (and so represent, for each category, the point estimate and 95% CIs of the effect in that category).
| Moderator | Category | \(\beta\) | 95% CI | Marginal R2 (%) |
|---|---|---|---|---|
| Overall effect | - | -1.77 | -2.541 to -1 | - |
| Sex | - | - | - | 8.1% |
| - | Female | -0.872 | -1.998 to 0.254 | - |
| - | Male | -1.626 | -2.192 to -1.061 | - |
| - | Not reported | -5.504 | -8.89 to -2.118 | - |
| Category of disease model induction | - | - | - | 16.3% |
| - | Behavioural early life stress | -1.458 | -7.124 to 4.209 | - |
| - | Chronic unpredictable mild stress | -1.728 | -2.587 to -0.868 | - |
| - | Pharmacological early life stress | -2.026 | -5.85 to 1.797 | |
| - | Pharmacological post weaning stress | -0.921 | -3.07 to 1.228 | |
| - | Social or social defeat stress | -1.531 | -5.129 to 2.066 | |
| - | Surgical models | -4.8 | -7.807 to -1.793 | |
| Risk of Bias | - | - | - | 40.7% |
| - | 0 criteria met | -1.273 | -2.012 to -0.533 | - |
| - | 1 criteria met | -1.853 | -2.846 to -0.859 | - |
| Reporting completeness | - | - | - | 1.6% |
| - | per unit increase | 0.113 | -0.277 to 0.504 | - |
2.1.5 Sensitivity Analyses
We examine the robustness of the findings for the primary outcome by performing the following sensitivity analyses
Imputed rho values of 0.2 and 0.8
In the previous analyses for the effect of depression modelling on sucrose preference, we imputed a \(\rho\) value - the imputed within-study correlation between observed effect sizes - of 0.5. Here, we examine the effect of imputing \(\rho\) values of 0.2 and 0.8.
When the \(\rho\) value is assumed to be 0.2, depression modelling had a pooled effect on sucrose preference of SMD = -1.86 (95% CI: -2.51 to -1.2) with a prediction interval of -5.14 to 1.43).
When the \(\rho\) value is assumed to be 0.8, depression modelling had a pooled effect on sucrose preference of SMD = -1.6 (95% CI: -2.59 to -0.61) with a prediction interval of -6.43 to 3.22).
For reference the pooled effect size when rho is assumed to be 0.5 is -1.77 (95% CI: -2.54 to -1).
NMD
NMD analysis is not applicable to the analysis of the effects of disease modelling.
2.1.6 Reporting bias/small-study effects
Because of the relationship between SMD effect sizes and variance inherent in their calculation, where study size is small the standard approach to seeking evidence of small-study effects (regression based tests including Egger’s regression test for multilevel meta-analysis) can lead to over-estimation of small-study effect (see for instance 10.7554/eLife.24260). To address this we used Egger’s regression test for multilevel meta-analysis, with regression of SMD effect size against 1/√N, where N is the total number of animals involved in an experiment.
Egger regression based on 109 studies of modelling of depression where sucrose preference was measured showed a coefficient for a small study effect of 7.38 (95% CI: -12.3 to 27.05; p = 0.452).
2.2 Outcome 2: Dopamine concentrations
2.2.1 Risks of bias
Figure 2.2.1 shows the risk of bias traffic light plot for studies investigating the effect of modelling depression on dopamine concentrations in animals. The risk of bias assessment was performed using the SyRCLE RoB tool.
Figure 2.2.1
2.2.2 Reporting completeness
Figure 2.2.2 shows the traffic light plot for reporting completeness summary for studies investigating the effect of the modelling of depression on dopamine concentration in animals. The reporting completeness assessment was performed using the ARRIVE guidelines.
Figure 2.2.2
2.2.3 Meta-analysis
Multilevel analysis is only performed if there are 5 levels or more for at least one of Strain, Study and Experiment, and that is not the case here. 13 experimental comparisons were reported in 5 experiments reported from 5 publications and involving 3 different animal strains. We provide a conventional random effects model to illustrate the data. No subgroup analysis is performed.
2.3 Outcome 3: DOPAC concentration
This was only reported in 2 studies, so no further analysis will be performed.
2.4 Outcome 4: Dopamine / DOPAC ratio
This was only reported in 1 study, so no further analysis will be performed.
2.5 Outcome 5: Dopamine receptor biology
This was only reported in 1 study, so no further analysis will be performed.
3 Dopaminergic agent v Control
26 studies (133 comparisons) investigated the effects of Dopaminergic agents versus Control. The number of studies and individual effect sizes for each outcome were:
Sucrose preference*: 26 studies and 105 comparisons in 10 strains
Dopamine concentration: 3 studies and 13 comparisons in 2 strains
DOPAC concentration: 2 studies and 4 comparisons in 2 strains
DA/DOPC ratio: 1 studies and 9 comparisons in 1 strain
Dopamine receptor biology: 1 studies and 2 comparisons in 1 strain
* This outcomes was identified in the study protocol as primary outcomes of interest.
3.1 Outcome 1: Dopamine
3.1.1 Risks of bias
Figure 3.1.1 shows the risk of bias traffic light plot for studies investigating the effect of administering a dopaminergic agent on Sucrose preference in animals. The risk of bias assessment was performed using the SyRCLE RoB tool.
Figure 3.1.1
3.1.2 Reporting completeness
Figure 3.1.2 shows the reporting completeness traffic light plot for studies investigating the effect of administering a dopaminergic agent on Sucrose preference in animals. The reporting completeness assessment was performed using the ARRIVE guidelines.
Figure 3.1.2
3.1.3 Meta-analysis
The effect of administering a dopaminergic agent on Sucrose preference in animals using SMD as the effect size is shown in Figure 3.1.3. The pooled estimate for SMD across all individual comparisons is displayed as a diamond shape at the bottom of the plot. Dotted lines indicate the prediction interval of the pooled estimate.
Figure 3.1.3
Dopaminergic agents had a pooled effect on Sucrose preference of SMD = 0.86 (95% CI: 0.4 to 1.32 with a prediction interval of -1.28 to 3.01.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 0.86 |
| Study x Strain x Experiment | 35 | 0 |
3.1.4 Subgroup analyses and meta-regressions
For each outcome, the covariates of interest for subgroup analyses and meta-regressions were:
Sex
Method of disease induction
Route of intervention administration
Whether the intervention was prophylactic or therapeutic (i.e. administered before or after disease model induction)
Duration of treatment period
The intervention administered
The efficacy of the drug (i.e. whether the drug is a partial or full agonist)
The selectivity of the drug
Potency of the intervention
Dose of intervention
We also conducted subgroup analyses using (1) SyRCLE Risk of Bias and (2) ARRIVE reporting completeness assessment scores as covariates to evaluate their influence on effect size estimates. These were not specified in the study protocol, but evaluation of risk of bias is required for the Summary of Evidence table, and no studies were considered at low risk of bias or high reporting completeness to allow such a sensitivity analysis
The significance (p value) reported is that for a test of whether the moderators are significantly different one from another, rather than whether the effect is significantly different from 0.
Sex
Figure 3.1.4.1 displays the estimates for the pooled SMD’s when comparisons are stratified by sex of the animal. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by sex, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.1
The p-value for the association between the sex of animal groups used and outcome reported was 0.183.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 0.841 |
| Study x Strain x Experiment | 35 | 0 |
Category of disease induction
Figure 3.1.4.2 displays the estimates for the pooled SMD’s when comparisons are stratified by the category of disease induction. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by category of disease induction, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.2
The p-value for the association between whether genetic or pharmacological models were used and outcome reported was 0.471.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0.546 |
| Study x Strain | 26 | 0.528 |
| Study x Strain x Experiment | 35 | 0 |
Route of intervention administration
Figure 3.1.4.3 displays the estimates for the pooled SMD’s when comparisons are stratified by the route of intervention administration. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by route of intervention administration, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.3
The p-value for the association between the route of intervention administration and outcome reported was 0.635.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 0.879 |
| Study x Strain x Experiment | 35 | 0 |
Prophylactic or therapeutic intervention
Figure 3.1.4.4 displays the estimates for the pooled SMD’s when comparisons are stratified by whether the intervention was administered prophylactically or therapeutically. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by whether the intervention was administered prophylactically or therapeutically, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.4
The p-value for the association between whether the intervention was administered prophylactically or therapeutically and outcome reported was 0.178.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0.472 |
| Study x Strain | 26 | 0.555 |
| Study x Strain x Experiment | 35 | 0.004 |
Duration of treatment period
The p-value for the association between whether the intervention was administered prophylactically or therapeutically and outcome reported was 0.581.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0.637 |
| Study x Strain | 26 | 0.576 |
| Study x Strain x Experiment | 35 | 0.001 |
The intervention administered
Figure 3.1.4.5 displays the estimates for the pooled SMD’s when comparisons are stratified by the intervention administered. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by the intervention administered, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.5
The p-value for the association between the intervention and outcome reported was 0.793.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 1.486 |
| Study x Strain x Experiment | 35 | 0 |
Dose of intervention
In this iteration of the review, the dopaminergic agents tested against control for their effect on Sucrose preference were: aripiprazole, quinpirole, buproprion, pramipexole, 2_HBC, D-amphetamine, L-DOPA, SKF83959, amantadine, bromocriptine, simvastatin, selegiline, P. orientalis seed, piribedil, SKF38393, cryptotanshinone, dopamine, ropinirole and tranylcypromine. Meta-regression using the administered dose as an explanatory variable was conducted for each drug where this had been reported in 10 or more experiments from 3 or more publications. Where there are sufficient data, the dashed lines in the plot represents the 95% confidence interval of the regression line and the dotted lines represent the 95% prediction interval. Raw data are plotted with point size adjusted according to effect size precision.
Aripiprazole
The estimate for \(\beta\) was -0.245 (95% CI tp , p = 0.009).
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 4 | 0.233 |
| Study x Strain | 5 | 0 |
| Study x Strain x Experiment | 5 | 0 |
Quinpirole
The estimate for \(\beta\) was 0.001 (95% CI tp , p = 0.249).
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 2 | 0 |
| Study x Strain | 3 | 0.843 |
| Study x Strain x Experiment | 3 | 0.843 |
SyRCLE RoB assessment considered as a categorical variable
Figure 3.1.4.10 displays the estimates for the pooled SMD’s when comparisons are stratified by how many of the SyRCLE risk of bias assessment criteria (of which there are 10) that the experiment met. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by SyRCLE Risk of Bias, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.10
The p-value for the association between SyRCLE Risks of Bias reporting and outcome reported was 0.523.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 0.88 |
| Study x Strain x Experiment | 35 | 0 |
SyRCLE RoB assessment considering those studies where any item is at low risk of bias
Figure 3.1.4.11 displays the estimates for the pooled SMD’s when comparisons are stratified by whether of not any of the SyRCLE Risk of bias domains were rated as low risk of bias. Whiskers indicate the 95% confidence interval of each estimate. The overall pooled SMD, not stratified by SyRCLE Risk of Bias, is displayed as a diamond shape at the bottom of the plot.
Figure 3.1.4.11
The p-value for the association between low SyRCLE Risks of Bias reporting and outcome reported was 0.523.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0 |
| Study x Strain | 26 | 0.88 |
| Study x Strain x Experiment | 35 | 0 |
ARRIVE reporting guidelines performance
We provide a metaregression where the number of ARRIVE items met is considered as a continuous variable.
Figure 3.1.4.13
The estimate for \(\beta\) was -0.138 (p = 0.185).
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 10 | 0.518 |
| Study x Strain | 26 | 0.539 |
| Study x Strain x Experiment | 35 | 0 |
Heterogeneity explained by covariates (Dopaminergic agents and Sucrose preference)
The table below shows which of the covariates, if any, explain some of the heterogeneity observed in the effect sizes of the effect of TAAR1 agonists on Sucrose preference. We present marginal R2, which measures the proportion of variance explained by including moderators in the model (the % change in the between-studies variance when the covariate is included in the model, in other words the % of the heterogeneity explained by the variable). The co-efficients are derived form an RMA model fitted with an intercept (and so represent, for each category, the point estimate and 95% CIs of the effect in that category).
| Moderator | Category | \(\beta\) | 95% CI | Marginal R2 (%) |
|---|---|---|---|---|
| Overall effect | - | 0.862 | 0.403 to 1.322 | - |
| Sex | - | - | - | 4.9% |
| - | Female | 0.01 | -1.042 to 1.062 | - |
| - | Male | 0.829 | 0.401 to 1.258 | - |
| - | Not reported | NA | NA to NA | - |
| Category of disease model induction | - | - | - | 14.7% |
| - | Behavioural early life stress | 0.998 | -2.53 to 4.526 | - |
| - | Chronic unpredictable mild stress | 0.417 | -0.34 to 1.175 | - |
| - | Genetic models | 1.199 | -2.352 to 4.751 | - |
| - | Pharmacological early life stress | 1.91 | -0.337 to 4.158 | - |
| - | Pharmacological post weaning | 0.516 | -1.012 to 2.045 | - |
| - | Social or social defeat stress | 1.152 | -0.87 to 3.175 | - |
| - | Surgical models | 2.109 | 0.419 to 3.799 | - |
| Administration route | - | - | - | 5.5% |
| - | Intraperitoneal | 0.651 | 0.137 to 1.165 | - |
| - | Oral | 0.877 | 0.297 to 1.458 | - |
| - | Other | 1.242 | 0.11 to 2.375 | - |
| - | Subcutaneous | 1.208 | -0.241 to 2.658 | - |
| Prophylactic or therapeutic intervention | - | - | - | 6.8% |
| - | Prophylactic | 0.411 | -0.353 to 1.175 | - |
| - | Therapeutic | 0.961 | 0.247 to 1.674 | - |
| Duration of treatment period | - | - | - | 3.9% |
| - | 1 to 4 weeks | 0.764 | -0.048 to 1.576 | - |
| - | less than 1 week | 1.07 | -0.285 to 2.425 | - |
| - | 4 weeks or more | 0.42 | -0.469 to 1.31 | - |
| Intervention administered | - | - | - | 18.1% |
| - | 2-HBC | 0.087 | -1.703 to 1.877 | - |
| - | amantadine | 1.384 | -0.898 to 3.666 | - |
| - | aripiprazole | 0.901 | -0.479 to 2.282 | - |
| - | bromocriptine | -0.274 | -2.221 to 1.673 | - |
| - | buproprion | 0.344 | -1.429 to 2.117 | - |
| - | cyrptotanshinone | 1.082 | -2.066 to 4.23 | - |
| - | dopamine | 0.168 | -2.786 to 3.122 | - |
| - | L-DOPA | 1.623 | -0.001 to 3.247 | - |
| - | P.orientalis seed | -0.142 | -2.017 to 1.733 | - |
| - | pramipexole | 1.773 | -1.337 to 4.883 | - |
| - | quinpirole | 1.139 | -1.837 to 4.114 | - |
| - | ropinerole | 0.365 | -1.824 to 2.554 | - |
| - | selegiline | 0.773 | -0.708 to 2.255 | - |
| - | simvastatin | 0.928 | -2.292 to 4.149 | - |
| - | SKF38393 | 0.998 | -15.277 to 17.273 | - |
| - | SKF83959 | -0.152 | -2.074 to 1.77 | - |
| - | tranylcypromine | 2.097 | -0.23 to 4.424 | - |
| Risk of Bias | - | - | - | 1.7% |
| - | 0 criteria met | 0.776 | 0.269 to 1.284 | - |
| - | 1 criteria met | 1.066 | 0.296 to 1.836 | - |
| Reporting completeness | - | - | - | 5.1% |
| - | per unit increase | -0.138 | -0.347 to 0.071 | - |
3.1.5 Sensitivity Analyses
We examine the robustness of the findings for the primary outcome by performing the following sensitivity analyses
Imputed rho values of 0.2 and 0.8
In the previous analyses for the effect of TAAR1 agonists on Sucrose preference, we imputed a \(\rho\) value - the imputed within-study correlation between observed effect sizes - of 0.5. Here, we examine the effect of imputing \(\rho\) values of 0.2 and 0.8.
When the \(\rho\) value is assumed to be 0.2, the TAAR1 interventions had a pooled effect on Sucrose preference of SMD = 1.05 (95% CI: 0.65 to 1.44) with a prediction interval of -0.78 to 2.88).
When the \(\rho\) value is assumed to be 0.8, the TAAR1 interventions had a pooled effect on Sucrose preference of SMD = 0.46 (95% CI: -0.09 to 1) with a prediction interval of -2.17 to 3.09).
For reference the pooled effect size when rho is assumed to be 0.5 is 0.86 (95% CI: 0.4 to 1.32).
NMD
For Sucrose preference, an NMD was calculable for 102 out of 105 comparisons, i.e. 97.14 % of comparisons.
The effect of administering a TAAR1 agonist on Sucrose preference in animals using NMD as the effect size is shown in Figure 3.1.5. The pooled estimate for NMD across all individual comparisons is displayed as a diamond shape at the bottom of the plot. Dotted lines indicate the prediction interval of the pooled estimate.
Figure 3.1.5
Dopaminergic interventions had a pooled effect on Sucrose preference of NMD = 70.82 (95% CI: 53.42 to 88.22) with a prediction interval of -19.46 to 161.09). For reference the pooled effect size for SMD was 0.86 (95% CI: 0.4 to 1.32).
102 experimental comparisons were reported in 34 experiments reported from 25 publications and involving 9 different animal strains.
| Level | Number of categories for that level included in this analysis | Attributable variance |
|---|---|---|
| Strain | 9 | 0.04 |
| Study x Strain | 25 | 976.56 |
| Study x Strain x Experiment | 34 | 498.95 |
3.1.6 Reporting bias/small-study effects
Because of the relationship between SMD effect sizes and variance inherent in their calculation, where study size is small the standard approach to seeking evidence of small-study effects (regression based tests including Egger’s regression test for multilevel meta-analysis) can lead to over-estimation of small-study effect (see for instance 10.7554/eLife.24260). To address this we used Egger’s regression test for multilevel meta-analysis, with regression of SMD effect size against 1/√N, where N is the total number of animals involved in an experiment.
Egger regression based on 105 studies of TAAR1 Agonist v Control where Sucrose preference was measured showed a coefficient for a small study effect of 10.05 (95% CI: -3.04 to 23.14; p = 0.128) in the context of a baseline estimate of effect of -1.79 (95% CI: -5.5 to 1.93; p = 0.300).
3.2 Outcome 2: Dopamine concentration
3.2.1 Risks of bias
Figure 3.2.1a shows the risk of bias summary for studies investigating the effect of administering a TAAR1 agonist on Sucrose preference in animals. The risk of bias assessment was performed using the SyRCLE’s RoB tool. Figure 3.2.1b shows the corresponding traffic light plot.
Figure 3.2.1
3.2.2 Reporting completeness
Figure 3.2.2a shows the reporting completeness summary for studies investigating the effect of administering a TAAR1 agonist on Sucrose preference in animals. The reporting completeness assessment was performed using the ARRIVE guidelines. Figure 3.2.2b shows the corresponding traffic light plot.
Figure 3.2.2
3.2.3 Meta-analysis
Multilevel analysis is only performed if there are 5 levels or more for at least one of Strain, Study and Experiment, and that is not the case here. 13 experimental comparisons were reported in 3 experiments reported from 3 publications and involving 2 different animal strains. We provide a conventional random effects model to illustrate the data. No subgroup analysis is performed.
3.3 Outcome 3: DOPAC concentration
This was only reported in 2 studies, so no further analysis will be performed.
3.4 Outcome 4: Dopamine / DOPAC ratio
This was only reported in 1 study, so no further analysis will be performed.
4. Observed relationships between different outcomes measures in the same cohorts of animals
We selected cohorts where at least one outcome was presented for at least two outcome types. Where there were two or more of the same outcome type within a cohort we calculated a standardised mean difference effect size for that outcome in that cohort, along with its standard error. Where there was a single effect size within a cohort we took the standard error of that effect size.
Then, for each pair of outcome measures we plotted the effect sizes for each cohort, and fitted a regression line weighted on the standard error in the outcome measure represented on the x-axis. Outcome measure pairs are coded according to whether they come from model induction studies (red, expectation of worsening anhedonia) or from intervention studies (gree, expecttaion of improvement in anhedonia). The number of experimental comparisons observed from each cohort is reflected in the size of the symbol, and shown in the figure legend.
4.1 Relationship between change in Sucrose preference test and change in measured dopamine concentrations
4.2 Relationship between change in Sucrose preference test and change in measured DOPAC concentrations
4.3 Relationship between change in Sucrose preference test and change in measured dopamine / DOPAC ratio
4.4 Relationship between change in Sucrose preference test and change in dopamine receptor biology
4.5 Relationship between change in dopamine concentrations and change in DOPAC concentrations
4.6 Relationship between change in dopamine concentrations and change in dopamine / DOPAC ratio
4.7 Relationship
between change in dopamine concentrations and change in dopamine
receptor biology
5. Attrition bias and adverse effects of treatment
1.52% of 1773 animals in Control cohorts and 1.61% of 1678 animals in Intervention cohorts ‘dropped out’ between allocation to group and outcome measurement. Given that 10 of 143 interventions (6.99%) were administered as a single dose, treatment emergent adverse effects likely to lead to withdrawal of an animal from the study would be unusual, and technical failure or attrition is more likely. This analysis is based on full reporting of animals excluded from analyses, and it may be that group sizes were specified ‘after the event’, or that there was unreported replacement of animals excluded during the experiment, so these data should be interpreted with caution.
6. Summary of the evidence
7. Software used
We used R version 4.3.1 (R Core Team 2023) and the following R packages: devtools v. 2.4.5 (Wickham et al. 2022), dosresmeta v. 2.0.1 (Crippa and Orsini 2016), ggpubr v. 0.6.0 (Kassambara 2023), gtools v. 3.9.4 (Bolker, Warnes, and Lumley 2022), Hmisc v. 5.1.1 (Harrell Jr 2023a), kableExtra v. 1.3.9.9001 (Zhu 2023), knitr v. 1.45 (Xie 2014, 2015, 2023), Matrix v. 1.6.1.1 (Bates, Maechler, and Jagan 2023), meta v. 6.5.0 (Balduzzi, Rücker, and Schwarzer 2019), metadat v. 1.2.0 (White et al. 2022), metafor v. 4.4.0 (Viechtbauer 2010), mvmeta v. 1.0.3 (Gasparrini, Armstrong, and Kenward 2012), numDeriv v. 2016.8.1.1 (Gilbert and Varadhan 2019), orchaRd v. 2.0 (Nakagawa et al. 2023), patchwork v. 1.1.3 (Pedersen 2023), PRISMA2020 v. 1.1.1 (Haddaway et al. 2022), rje v. 1.12.1 (Evans 2022), rms v. 6.7.1 (Harrell Jr 2023b), robvis v. 0.3.0.900 (McGuinness and Higgins 2020), tidyverse v. 2.0.0 (Wickham et al. 2019), usethis v. 2.2.2 (Wickham et al. 2023), xtable v. 1.8.4 (Dahl et al. 2019).
SMD_S_cog_CatDisInd[SMD_S_cog_CatDisInd$CategoryDiseaseInduction == “Genetic”][[“k”]]